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Abstract. The dynamics of noise-resilient Boolean networks with majority functions 
and diverse topologies is investigated. A wide class of possible topological 
configurations is parametrized as a stochastic blockmodel. For this class of networks, 
the dynamics always undergoes a phase transition from a non-ergodic regime, where 
a memory of its past states is preserved, to an ergodic regime, where no such memory 
exists and every microstate is equally probable. Both the average error on the network, 
as well as the critical value of noise where the transition occurs are investigated 
analytically, and compared to numerical simulations. The results for "partially dense" 
networks, comprised of relatively few, but dynamically important nodes, which have a 
number of inputs which greatly exceeds the average for the entire network, give very 
general upper bounds on the maximum resilience against noise attainable on globally 
sparse systems. 
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1. Introduction 

An essential feature of many self-organized and artificial systems of several interacting 
elements is the ability of to function in a predictable fashion even in the presence of 
stochastic fluctuations, which are inherent to the system itself. Good examples are 
biochemical signaling networks and gene regulation in organisms [T], as well as artificial 
digital circuits, and communication networks [2|. In such systems, it is often the case 
that the source of the fluctuations cannot be entirely removed, and the system must 
be able to deal with them, by incorporating appropriate error- correct ion measures. 
These may include specific dynamical properties [3,11], choice of functional elements 
and structural properties [HIE], which one way or another result in enough information 
redundancy, which can be used to counteract the deviating effects of noise. In this 
work, the focus is turned on optimal bounds which can be attained by a wide class of 
such systems, when many parameters can be freely varied. More precisely, we consider a 
paradigmatic system of dynamically interacting Boolean elements, regulated by Boolean 
functions, where noise is introduced by the probability that at any time, any input of a 
given function can be "flipped" to its opposite value, before the output of the function 
is computed. The networks considered are regulated by optimal majority functions, 
and can possess arbitrary topological structures. The choice of majority functions 
corresponds to the limiting case where the trade-off between robustness against noise 
and fitness for a given task is at a maximum for every function in the network. 

We obtain - both analytically and numerically - relevant properties of the system, 
such as the average probability of error as a function of noise, and critical value of noise, 
for which reliability is no longer possible. At this noise threshold, the system undergoes 
a dynamic phase transition from a non-ergodic regime, where a memory of its past states 
is preserved, to an ergodic regime, where no such memory exists and every microstate 
is equally probable. We identify the most relevant topological properties which can 
confer more robustness to the system, namely the existence of a more densely connected 
subset of the network, which is responsible for the dynamics of a significant portion of 
the system. The properties of such optimal topologies serve as general optimal bounds 
on the maximum resilience against noise which is attainable by this class of system. 

The behavior of similar systems under noise has been studied previously by a 
number of authors. The dynamics of random Boolean networks (RBNs) with noise 
(random functions and topology, not necessarily aiming at robustness [7]) was studied 
in [8]-|15|. The early works presented in [8HTU] considered only small networks with 
iV < 20 nodes, and focused on the average crossing time between trajectories in state 
space which started from different initial states. It was found that the trajectories must 
cross over "barriers," which correspond to the attractor basin boundaries. However, the 
probability of crossing is always non-vanishing in such small systems. It was further 
shown in [15] that the dynamics of RBNs is always ergodic for any positive value of 
noise, and thus cannot preserve any memory of its past states. However, this is not true 
for random networks composed of threshold or majority functions, as shown in |TTjlT6]. 
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These networks undergo the aforementioned phase transition between ergodicity and 
non-ergodicity at a critical value of noise. The same type of transition has also been 
observed for Boolean systems composed of majority functions, but having acyclic and 
stratified topology (i.e. Boolean formulas) [TTJUH]. It was also shown in [5] that this 
transition has a general character, since any Boolean network can be made robust by 
introducing an appropriate restoration mechanism with majority functions. 

Boolean networks with majority functions share some similarities with the so-called 
majority voter model [T91I20] . which is usually defined on undirected regular lattices. 
This system also undergoes a phase-transition based on noise, which belongs to the 
universality class of the Ising model |21j . 

The issue of reliable computation under noise has also been tackled by the 
mathematical community, starting with von Neumann [22], who was the first to notice 
an important difference between reliable computation of noisy Boolean circuits and the 
more general scenario of reliable communication considered by Shannon [2], namely that 
it is not possible to guarantee an arbitrarily small error rate, if the a given circuit has 
a fixed number of inputs per function. He also pointed out that reliable computation is 
not at all possible for Boolean functions with three inputs after a given noise threshold. 
His results were later improved by Evans and Pippinger [23], who proved a similar bound 
for Boolean formulas with two inputs per node, and finally Evans and Schulman [23] 
who proved the bound for Boolean formulas with any odd number of inputs per node. 
Recently, an extension to these bounds which are also valid for functions with even 
number of inputs was derived in |25j . 

This paper is divided as follows. In section [2] we describe the model and in section [3] 
we analyse the phase transition based on noise for several different topological models: 
In 13.11 we consider random networks with a single- valued in-degree distribution, and 
in 13.21 we extend the model to arbitrary in-degree distributions. In 13.31 we consider a 
more general stochastic blockmodel, which represents a much larger class of possible 
topological structures. We finalize in section H] with some concluding remarks. 

2. The model 

A Boolean Network (BN) |26|[27] is a directed graph of N nodes representing Boolean 
variables a G {1,0}^, which are subject to a deterministic update rule, 



where /, is the update function assigned to node i, which depends exclusively on the 
states of its inputs. It is also considered that all nodes are updated in parallel. 

Here, noise is included in the model by introducing a probability P that at each 
time-step a given input has its value "flipped": o~j — > 1 — o~j, before the output is 
computed [15] . This probability is independent for all inputs in the network, and many 
values may be flipped simultaneously. The functions on all nodes are taken to be the 




(1) 
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majority function, defined as 

^0 otherwise, 

where ki is the number of inputs of node %. The definition above will lead to a bias if 
fcj is an even number, since if the sum happens to be exactly ki/2 the output will be 
0, arbitrarily Alternative definitions could be used, which would remove the bias |28j. 
Instead, for the sake of simplicity, in this work all values of ki considered will be odd, 
making this bias a non-issue. 

Starting from a given initial configuration, the dynamics of the system evolves and 
eventually reaches a dynamically stable regime, where (for sufficiently large systems) 
the average value bt of l's no longer changes, except for stochastic fluctuations In 
the absence of noise (P = 0) there are only two possible attractors (if the network is 
sufficiently random and not disjoint), where all nodes have the same value, which can 
be either or 1. We will consider these homogeneous attractors as being the "correct" 
dynamics, and denote the deviations from them as "errors". More specifically, without 
loss of generality, we will name the value of 1 as an "error", and the value of bt as the 
average error on the system. 

We note that the above model has an optimal character regarding robustness against 
noise, for the following two reasons: 1. It is known that the majority function as defined 
in Eq. [2] is optimal in the case of fully redundant inputs (i.e. in the absence of noise, 
they all have simultaneously the same value), which have an uniform and independent 
probability of being "flipped" by noise. In this situation, the output of the majority 
function will be "correct" with greater probability than any other function with the 
same number of inputs [22 | |24" ] . 2. The existence of only two possible attractors with 
uniform values can be interpreted as an extremal trade-off between dynamical function 
and increased resilience against noise: A network with more elaborate dynamics in the 
absence of noise, composed of many attractors with smaller basis of attraction, would 
be invariably more difficult to stabilize if noise is present, since it would become harder 
to distinguish between dynamical states. 

3. Dynamical phase transition based on noise 

As previously defined, the average "error" on the network is characterized by the average 
value of l's in the network at a given time, b t . In this section we will obtain the 
value of b t for networks with different topological characteristics. We will focus first on 
uniform random networks with all functions having the same in-degree, and networks 
with arbitrary in-degree distributions. We then move to an arbitrary blockmodel, which 
can incorporate more general topological features. 



(2) 
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3.1. Single-valued in-degree distribution 

In this session, we compute the value of bt for networks composed of nodes with the same 
number k of inputs per node, which are randomly chosen between all possible nodes. 
This type of system has been studied before by Huepe et al jllj and is essentially 
equivalent to the same problem posed for Boolean formulas by Evans et. al [24] . since 
the presence of short loops can be neglected for large networks. For the sake of clarity, 
we shortly reproduce the analysis developed in [21], and we extend it by calculating the 
critical exponent of the transition. We then proceed to generalize the approach to more 
general topologies in the subsequent sections. 

In order to obtain an equation for the time evolution of bt we employ the usual 
annealed approximation [29] , which assumes that at each time step the inputs of every 
function are randomly re-sampled, such that any quenched topological correlations are 
ignored, and all inputs will have the same probability b t of being equal to 1. If the 
inputs of a majority function have a value of 1 with probability b (independently for 
each input), the output will also be 1 with a probability given by 

m ^= E ( k )v(l-b) k -\ (3) 

i=\k/2\ ^ ' 

The time evolution of b t can then be written as 

b t+1 = m k ((l-2P)b t + P), (4) 

where P is the noise probability, as described previously. The right-hand side of Eq. H] 
is symmetric in respect to values of bt around 1/2 (as can be seen in Fig. [T]), such that 
the dynamics for values of b' t > 1/2, can be obtained from b' t = 1 — b t , with b t < 1/2. 
Thus, without loss of generality, we will only consider the case bt < 1/2 throughout the 
paper. 

Given any initial starting value 6 < 1/2) the dynamics will always lead to a fixed 
point b* < 1/2, which is a solution of Eq. HJ with bt+i = b t = b*. This is in general a 
solution of a polynomial of order k, for which there are no general closed-form expression. 
However, since the right-hand side of Eq. H] is a monotonically increasing function on 
bt, we can conclude there can be at most two possible fixed points: b* = 1/2 (ergodic 
regime) or b* < 1/2 (non-ergodic regime). Furthermore, considering the right-hand side 
of Eq. H] is a convex function (for bt < 1/2, as is always assumed), if the fixed point 
b* = 1/2 becomes stable, i.e. d ^ 1 \b*=i/2 < 1; the other fixed point b* < 1/2 must 
cease to exist, since in this case bt+i > h for any b t < 1/2. Thus, the value of P for 
which b* = 1/2 becomes a stable fixed point marks the transition from non-ergodicity 
to ergodicity. In order to obtain this value, we need to compute the the derivative of 
the right-hand side of Eq. H]in respect to bt- Using the derivative of Eq. [3] (see [21] for 
a detailed derivation of this expression), 

«4W^ = ^(f^)[i-(i-^ 00 
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we have that (1 — 2P*)m' k (l/2) = 1, where P* is the critical value of noise. Thus, a full 
expression for P* is given by 

1 2 fc ~ 2 

(6) 



P* 



M|fc/2j) 



Taking the limit k 3> 1, one obtains P* « | — g-v/ifc us i n S the Stirling approximation. 
Eq. [6] is the main result of [21]. We note however that a slightly less explicit but 
more general expression was derived previously in [11] . for the case where the majority 
function accepts inputs with different weights. 

For a given value of k, the value of b* increases continuously with P until it reaches 
1/2 for P > P* (see Fig. [T]), characterizing a second-order phase transition. One can 
go further and obtain the critical exponent of the transition by expanding Eq. [3] near 
6=1/2, 



m k (b) 



\ - \m' k {l/2)(l - 2b) + i[*/2V fc (l/2)(l - 2bf 



and using it inHJ and solving for b* = b t+ i = b t , which leads to 



1 
2 



3 *4(1/2)* 
2 [_k/2\ 



P 



1/2 



0((l-26) 5 ) (7) 



(8) 



where P = P* — P. From this expression it can be seen that the critical exponent is 
1/2, corresponding to the mean- field universality class. 





Figure 1. The dynamic map of Eq. |4]for different values of P (left), and the value of 
the stable fixed-point b* < 1/2, as a function of P (right). 

The values of b* and P* can be understood as general bounds on the minimum 
error level and maximum tolerable noise, respectively, which must hold for random 
networks composed of functions with the same number of inputs. These are rather 
stringent conditions, and it is possible to imagine interesting situations where they are 
not fulfilled. Therefore, for more general bounds, one needs to relax these restrictions. 
We proceed in this direction in the following section, where we consider the case of 
arbitrary in-degree distributions, but otherwise random connections among the nodes. 
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3.2. Arbitrary in-degree distributions 

We turn now to uncorrelated random networks with an arbitrary distribution of inputs 
per node (in-degree), p^. Here it is assumed that the inputs of each function are 
randomly chosen among all possibilities, and that the in-degree distribution p k provides 
a complete description of the network ensemble. This configuration was also considered 
in [16], for a more general case where the inputs can have arbitrary weights. We analyse 
here the special case with no weights in more detail, and obtain more explicit results. 

The annealed approximation can be used in the same manner as in the previous 
section: One considers simply that at each time step the inputs of each function are 
randomly chosen 0. The time evolution of b t now becomes, 

b t+1 = ^2p k m k ((l-2P)b t + P). (9) 

k 

Like for Eq. HJ there are only two fixed points b* < 1/2, and the transition can be 
obtained by analysing the stability of the fixed point b* = 1/2. In an entirely analogous 
fashion to Eq. |6l using the derivative of the right-hand side of Eq. [9] one obtains the 
following expression for the critical value of noise, 



1 
2 



(10) 



Note 



Considering the limit where all k 1, one has P* ?a ~ — y ^ ^2 k Pk"/k 
that the above expression only holds if p^ = for every k which is even, as is assumed 
throughout the paper. The critical exponent can also be calculated in an analogous 
fashion, and is always 1/2, unless p k has diverging moments. In this case the critical 
exponents will depend on the details of the distribution (see P3] for a more thorough 
analysis) . 

With this result in mind, one can ask the following question: What is the best 
in-degree distribution, for a given average in-degree (k), such that either b t is minimized 
or P* is maximized? As it will now be shown, in either case the best distribution is the 
single-valued distribution, already considered in the previous section. For simplicity, let 
us consider the case where (k) is discrete and odd. We begin with the analysis of b t . 
We can observe that for b < 1/2, m k (b) is a convex function on k (see Fig [2]), 

m k{b) < , (11) 

and thus by Jensen's inequality we have that m^){b) < (m k (b)). Since the equality 
only holds only for the single-valued distribution p k = 5 k ,(k) (assuming b ^ {0,1/2}), 
the right-hand side of Eq. [9] will always be larger for any other distribution p k . The 

\ Note that this input "rewiring" has no effect on the in-degree distribution. 
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same argument can be made for the value of P*\ Since we have that (1 — 2P* 
YlkPk m 'k(^-/2), and m' k (l/2) is a concave function on k, 



m' fc _ 2 (l/2) + m' fc+2 (l/2) _ m' fc (l/2) 
2 2 

= m' k (l/2) 
< m' k (l/2) 



k 



k 



k + 2 
k + l 



2k{k+l) 



(12) 

(13) 
(14) 



we have that m', k \(l/2) > (m' k (l/2)). Again, the equality only holds only for p^ = Sk,(k), 
which is therefore the optimal scenarioJ§| 
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Figure 2. Convexity of irik(b), as stated in Eq. ITT1 

One special case which merits attention is the scale-free in-degree distribution 

Pk oc k" 7 , (15) 



which occurs often in many systems, including, as some suggest, gene regulation |30j. 
It is often postulated that networks with such a degree distribution are associated with 
different types of robustness, due to their lower percolation threshold [31] which can be 
interpreted as a resilience to node removal "attacks". However, in the case of robustness 
against noise Eq. [15] by itself does not confer any advantage. For instance, from Eq. [10] 
using Stirling's approximation one sees that the expression within brackets will diverge 
only if 7 < 3/2, leading to P* = 1/2. This means that for 3/2 < 7 < 2, we have that the 
average in-degree diverges ({k) — > 00) but the critical value of noise is still below 1/2. 
This is considerably worse, for instance, than a fully random network with in-degree 
distribution given by a slightly modified Poisson, which is defined only over odd values 
of k, 

1 \ k 

^ k sinh A k\ ' ^ 

§ Of course, this argument does not hold if (fc) is not discrete and odd, since in this case the distribution 
cannot be single- valued. But the above argument should make it sufficiently clear that in this case the 
optimal distribution should also be very narrow, and similar to the single-valued distribution. 
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with (k) = A/ tanhA. For this distribution, we have that P* — > 1/2 for (k) — > oo, as 
one would expect also for the single-valued distribution. A comparison between these 
two distributions is shown in Fig. [3j 




Figure 3. Critical value of noise P* as a function of 7 for the scale-free in-degree 
distribution given by Eq. [T5] and for the Poisson distribution given by Eq. 1161 where A 
is chosen such that the average in-degree is the same for both distributions. 

The above analysis shows that the single- valued in-degree distribution p^ = SkJk) 
is the best one can hope for with a given average in-degree (k), as long as the inputs of 
each function are randomly chosen. However, this is a restriction which does not need 
be fulfilled in general. In order to obtain more general bounds, one needs to depart from 
this restriction, and consider more heterogeneous possibilities, which is the topic of the 
next section. 

3.3. Arbitrary topology: Stochastic blockmodels 

We now consider a much more general class of networks known as stochastic 
blockmodels [3"2"H34| . where it is assumed that every node in the network can belong 
one of n distinct classes or "blocks". Every node belonging to the same block has 
on average the same characteristics, such that we need only to describe the degrees 
of freedom associated with the individual blocks. In particular we use the degree- 
corrected variant [35] of the traditional stochastic blockmodel, which incorporates degree 
variability inside the same block. Here, we define Wi to be the fraction of the nodes in 
the network which belong to block i, and p\ is the in-degree distribution of block i. 
The matrix Wj^i describes the fraction of the inputs of block i which belong to block 

j. We have therefore that J2i w i = 1> ^2j w j-^i = 1 an d Ylik^ Wi Pk = (^)- Since the 
out-degrees are not explicitly required to describe the dynamics, they will be assumed 
to be randomly distributed, subject only to the restrictions imposed by Wi and Wj^. 
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In the limit where the number of vertices NvJi belonging to each blocks i is 
arbitrary large, we can use a modified version of the annealed approximation to describe 
the dynamics: Instead of randomly re-assigning inputs for each function, we choose 
randomly only amongst those which do not invalidate the desired block structure. 
In other words, we impose that after each random input rewiring, the inter-block 
connections probabilities are always given by Wj^. In this way, we maintain the 
dynamic correlations associated with the block structure, and remove those arising 
from quenched topological correlations present in a single realization of the blockmodel 
ensemble. Due to the self-averaging properties of this ensemble, for sufficiently large 
networks the annealed approximation is expected to be exact, in the same way it is for 
random networks without block structures. 

With this ansatz, we can write the average value of hi for each block over time as 

k(t + 1) = $>> fc (|(1 - 2P) Y^w^h^t) + Pj , (17) 

which is a system of n coupled maps. It is easy to see that b* = 1/2 is a fixed point 
of Eq. [171 In order to perform the stability analysis we have to consider the Jacobian 
matrix of the right-hand side of Eq. [T7] 



Jij 



j 

At the fixed-point bi(t) = 1/2 we can write the Jacobian as 

J* = (1-2P)M, (19) 



where matrix M is given by 



M y = u^Xy fc mUV2)- (20) 



The largest eigenvalues of J* and M, A and £ respectively, are related to each other 
simply by A = (1 — 2P)£. Since the fixed-point in question will cease to be stable for 
A = 1, we have that the critical value of noise is given by 

1 1 

P* = -. 21 

2 2£ v 1 

Thus, for P > P* the fixed point bi(t) = 1/2 becomes a stable fixed-point, and this 
marks the transition from non-ergodicity to ergodicity, as in the previous cases. 

We note that the sizes of the blocks i«j play no role in Eq. (2TJ and only the 
correlation probabilities w^j and the in-degree distributions p\ define the value of 
P*. For this reason, the average error b* = X^i^A on the network may not be always 
a suitable order parameter to identify the aforementioned phase transition, since the 
blocks which are responsible for the value of P* may be arbitrarily small in comparison 
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to the rest of the network. However, these are obviously corner cases, since the most 
interesting situations are those where all blocks are relevant to the dynamics (or a given 
block could be otherwise ignored). 

Given any desired many-block structure, one could find the largest eigenvalue £ 
of the matrix M and then determine the critical value of noise with Eq. [2TJ In the 
following, we will focus on the simplest nontrivial block structure which is composed only 
of two blocks. Such 2-block systems are fully accessible analytically, and are sufficient 
to obtain more general upper and lower bounds on the values of P* and b*, respectively. 



3.4- 2-block structures 

Here we consider networks composed of two blocks, where the block with the largest 
average in-degree will be labeled "core". The size and average in-degree of the core 
block are w c and k c respectively, and for the non-core block w r — 1 — w c and 
k r = ((k) —w c k c ) / (1— w c ). For simplicity, we will consider that the in-degree distribution 
of each block is the single- valued distribution p\ = 8%^, where fcj is the average in-degree 
of the block. 

The matrix has the general form 



w^= [ = , (22) 





with only two free variables m c and m r , denoting the fraction of inputs which belong to 
the core block, for both blocks. Instead of considering all possible values of m c and m r , 
we consider the following parametrization 



4a(l - a)w c if a < 1/2 

m r if a > 1/2 ( 23 ) 



m r = 1 — 4a(l — a)(l — w c ), 

where the single parameter a G [0, 1] allows for the topology to be continuously varied 
between three distinct topological configurations (see Fig. H|): For a = we have a 
"restoration" topology, where the network is bipartite, and all inputs from the non-core 
block belong to the core block and vice- versa; for a = 1/2 the inputs are randomly 
selected; and for a = 1 we have a "segregated core" structure, where all the inputs of 
both blocks belong exclusively to the core block. 

For this system we can write the matrix M from Eq. [20] as 

M= , w c ^ c m' kc (l/2) w r ^ c m' kc (l/2) . 
w c ^ r m' kr (l/2) w r ^ r m' kr {\/2) 
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a = a = 1/2 a = 1 

Restoration Random Segregated core 

Figure 4. Three distinct 2-block structures possible with the parametrization given 
by Eq. [531 f° r different values of the parameter a. 

from which we can extract the largest eigenvalue £, 

f = -K_> c m' fcc (l/2) + ww7/ fcr (l/2)) + 

i V / 4^ c ^ r m' fec (l/2)m' fcr (l/2) + - ^m'Jl/2)) 2 . (25) 

From £, the critical value of noise can be obtained by Eq. [2TJ 

The general behaviour of the asymptotic average error b* = lim^oo (bi(t)), 
computed from Eq. [T7] as a function of a is shown in Fig. [5] for (k) = 5 and k r = 3, 
and several values of k c (and w c chosen accordingly). In the same figure are shown 
results from numerical simulations of quenched networks with N = 10 5 nodes, evolved 
according to Eq. HJ showing perfect agreement. On the right of Fig. [5] are shown the 
values of b* according to the reduced noise P — P*, with P* computed according to 
Eqs. [25] and [2TJ The calculated values of P* for several values of k c are plotted on the 
right of Fig. [6] The nature of the phase transition is systematically the same, as can 
be seen in the right of Fig. El where the slope of the curves correspond to mean-field 
critical exponent 1/2. 

It is interesting to compare the performance of the restoration (a = 0) and 
segregated core (a = 1) topologies. Both outperform the random topology (a = 1/2), 
but the segregated core is always the best possible, having both the lowest values of b* 
and largest values of P*. This is not surprising, since the segregated core is nothing more 
than an isolated network, which is more densely connected than the whole network, to 
which the remaining nodes are enslaved. On the other hand it is rather interesting how 
the restoration topology (a = 1) is only marginally worse than the segregated core, since 
in this situation every node is dynamically relevant. We note that the relative advantage 
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a p p* 



Figure 5. Average error b* as a function of a for different values of noise P (left) and 
as a function of the reduced noise P — P* , with P* computed according to Eqs. l25l 
and CHI for several values of a (right). All curves are for (k) — 5, k r = 3 and k c = 19. 
The symbols are results of numerical simulations of quenched networks with N = 10 5 
nodes, and the solid lines are numerical solutions of Eq. 1171 
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Figure 6. Critical value of noise P* as a function of a, for several values of k c , with 
k r = 3 and (k) = 5 (left), and value of 1 — 2b* as a function of P— P* close to the critical 
point, for different values of (k), a, k r and k c (right). The dashed line corresponds to 
a function proportional to (P — P*) 1 / 2 . 

of the partially random topologies (0 < a < 1) may depend on the actual value of noise. 
This can be seen in Fig. |5] (right), where the curves for b* with different values of a 
cross each other when P — P* is varied (the same is also observed when the curves are 
plotted against P). The reason for this is that the relative advantage of the segregated 
core topology in respect to restoration may manifest itself only as the value of noise 
approaches the critical point. For lower values of noise it is possible, for instance, for a 
full restoration topology with a = to outperform a partial segregated core structure 
with a = 0.9, since it will perform comparably to a full segregation, a = 1 (see Fig. |5l 
left). However, as noise is increased the relative advantage of the segregated topology 
makes up for this difference. In the general case, therefore, the optimal topology will 
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depend on the value of noise. 

Either with the restoration and segregated core topologies, the values of b* and P* 
become increasingly better for larger values of k c , as can be seen in Figs. [6]and[7J One 
can therefore postulate that an optimum bound can be achieved for k c — > oo. Let us 
consider the situation where w c oc l/k c , such that lim/ Cc _ i . 00 (k) = k r . For both a = and 
a = 1 the value of b* approaches asymptotically m^)(P), for k c — > oo, as can be seen in 
Fig. [7J This means that the average error of the core nodes will eventually vanish, and 
the remaining nodes will encounter the optimal scenario where the inputs are affected 
by the noise P alone, and the error does not accumulate over time. It is therefore safe 
to conclude that 

b mi n = m {k) (P) (26) 

is a general lower bound on the average error on a network with average in-degree (k) 
and an arbitrary topology, which is asymptotically achieved for both the restoration and 
segregation topologies, for k c — > oo. 




0.0 0.1 0.2 0.3 0.4 0.5 0.0 0.1 0.2 0.3 0.4 0.5 

P P 



Figure 7. Values of b* as a function of P for 2-block structures with a = 1 (left) and 
a = (right), with w c = 1/(100 x k c ), k r = 5 and several values of k c . The dashed 
curves are given by Eq. [26] with (k) = k r . 

4. Conclusion 

We have investigated the behaviour of optimal Boolean networks with majority functions 
and different topologies in the presence of stochastic fluctuations. The dynamics of 
these networks undergo a phase transition from ergodicity to non-ergodicity. The 
non-ergodic regime can be can be interpreted as robustness against noise, since there 
is a permanent global memory of the initial condition. The ergodic phase, on the 
other hand, represents a situation where the effect of noise has destroyed any possible 
long-term dynamical organization of the system. We obtained, both analytically and 
numerically, the average error and the critical value of noise for networks composed of 
arbitrary in-degree distributions and for a more general stochastic blockmodel, which can 
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accommodate a wide variety of network structures. We showed that both the average 
error level as well as the critical value of noise are improved both for the segregated 
core and restoration topologies, where the dynamics is dominated by a smaller subset 
of nodes, which have an above-average in-degree. In the limit where the average in- 
degree of these "core" nodes diverges, the network achieves an optimum bound, which 
corresponds to the maximum resilience attainable. 

In a separate work |6|, we show that segregated core structures emerge naturally 
out of an evolutionary process which favors robustness against noise. 

As was discussed, the networks considered are made from optimal elements, which 
in isolation have the best possible behaviour. Because of this, the results obtained have 
a general character, and show the best scenario which can in general be achieved, under 
the constraints considered. However, it is important to point out that there are different 
types of stochastic fluctuations which can be considered in Boolean systems. Other 
than the type of noise considered in this work, it is possible for instance to incorporate 
fluctuations in the update schedule of the nodes |36] . It has been shown in [37J, for 
random networks, that even if the update schedule is completely random, ergodicity is 
preserved, and the dynamics eventually leads to distinct attractors. Furthermore, it was 
shown in [3] that it is possible to obtain absolute resilience against noise in the update 
sequence, where the trajectories are always the same, independent of the update schedule 
used. In p[| this type of resilience has been coupled with single-flip perturbations, which 
correspond to very small values of the noise parameter P considered in this work, and 
it was shown that arbitrary mutual resilience is also possible. The broader question 
of how a single system can be simultaneously robust against many different types of 
perturbations, and which features become more important in this case, still needs to be 
systematically tackled. 
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